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Search for Mixing and CP Violation in Charm Decays 
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Standard model mixing and CP violation are expected to be small in the charm sector. Some argue that only 
in the presence of new physics do we currently expect to observe these effects. Fermilab experiment E791 has the 
largest sample of reconstructed charm decays recorded to date. We have made an exhaustive search for D°D 
mixing and CP violation in this data. We present the charm mixing limits on the mixing parameter r m ix using 
hadronic and semileptonic decays, and also present preliminary limits on the CP asymmetry parameter, Acp, 
for Cabibbo suppressed decays. 



1. E791 

E791 is a high statistics charm hadroproduc- 
tion experiment completed at Fermilab in 1992. 
We recorded 20 billion triggers in 500 GeV tt~N 
interactions at the Tagged Photon Spectrometer. 
Over 200K charm particles were reconstructed 
and are used for further charm analyses JO. 

The detector features 17 planes of silicon mi- 
crostrip detectors placed just behind a segmented 
Pt and C foil target. Charm decays are detected 
in the air gaps between target foils. Precision 
tracking of the incoming beam and a precise lo- 
cation of the secondary decay point allows a mea- 
surement of the proper decay time for charm par- 
ticles with a resolution of about .lrrjo. 

Particle identification is provided by two multi- 
cell threshold Cherenkov counters, giving ir/K 
separation in the 6-60 GeV/c momentum range. 
An electromagnetic and hadron calorimeter pro- 
vided good e/7r separation, as well as photon iden- 
tification. Muons are tagged in a pair of ho- 
doscopes following steel absorber at the down- 
stream end of the spectrometer. 



2. D°D MIXING 

D°D° mixing is expected to be small within 
the standard model (SM)|3). The time- integrated 
fraction of mixed decays relative to Cabibbo fa- 
vored (CF) decays is experimentally defined as 



the parameter r n 



N(D° 



where / is 



the final state. SM estimates for the mixing pa- 
rameter r m i x are in the range 10~ 7 — 10~ 10 . Any 
sign of mixing above these SM predictions, could 
be seen as a sign of new physics, although long 
range effects cannot be easily ruled outQ. 

We look for D°D mixing by searching for 
wrong-sign (ws) final states /, in a sample of ini- 
tially tagged D°'s, decaying to right sign (rs) fi- 
nal state /. In the limit of small mixing (LSM) 



this is expressed as r m i x ~ 
^22 « i and ^ « 1. 



^((^f) 2 + (t?) 2 ), 

Am and A7 are 
7 7 ' 

the mass and decay rate differences between CP 

eigenstates, and 7 is the average decay rate 

Doubly Cabibbo suppressed (DCS) decays can 
mimic the process. The total D° wrong sign de- 
cay (ws) rate, is given (LSM) by, 



F ws (D°(t) — > /) ~ [(A? 



+ 4 \p\ 2 + 2 Re(p)Aj t + 4Im(p)Am t] e" 7 * (1) 

The true mixing (r m i X ), DCS interference Re(p) 
and Im(p), and pure DCS (\p\ 2 ) components can 
be separated by their different time evolutions. 
Here mixing peaks at 2t d o and is sensitive to 
the tails of the DCS decay time distribution. In 
semileptonic final states DCS decays are not al- 
lowed and the mixing rate follows a pure t 2 x e -7 * 
dependence. 
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2.1. Hadronic Decay Channels 

We search for mixing in hadronic channels by 
using the charm decays D* + — ► D q tt£, then 
D° K^tt+, K^tt+tt-tt-^. The initial charm 
state is tagged by the sign of tt^,, the bache- 
lor pion originating in the primary vertex, to 
form a right sign (rs) and wrong sign (ws) sam- 
ple. A neural network optimization of signal- 
over-root-background, S/ \J~B 1 in the rs samples 
is used to search for mixing with maximum sen- 
sitivity in the ws samples. The Q- value, Q = 
M (Kit (it it) it t,)— M (Kir (it it))— M (lib) , and associ- 
ated proper decay time spectrum of right sign and 
wrong sign decays are extracted for each decay. 

A maximum likelihood fit (MLF) is performed 
which accounts for the true signal, and back- 
ground sources: misidcntificd D — ► tttt, KK, ran- 
dom pions with real D°'s, and random pions with 
fake Z?°'s. The Kit and K3w rs and ws data is fit 
simultaneously for r m i X and p parameters. We as- 
sume the residual background under the rs and 
ws signals is the same in shape, and fit it to a 
form determined from combining _D°'s and tt^s 
from different events. We do not assume CP in- 
variance when fitting any of the ws rates (mixing, 
DCS, interference), thus particle and antiparticlc 
mixing rates are differentiated. Since it is most 
likely that CP will be violated in the DCS inter- 
ference term, a special fit is performed under this 
condition. We also examine the cases of fits with 
no interference term and no CP violation, and 
no mixing term, to compare with previous exper- 
iments. A summary of fit results for the hadronic 
channels is given in Table 1. 

2.1. Semileptonic Decay Channels 

Charm decays through semileptonic channels 
offer a unique opportunity to search for mix- 
ing without DCS interference effects ( p = 
in eq. 1). E791 has reported the first mea- 
surement of D D° mixing with semileptonic de- 
cays, through the decay chain, D* + — > D°ir£, 
then D° — > Even though there is a 

missing neutrino in the decay, due to the small 
phase space available, an approximate, but nar- 
row, Q = M(K£TT b ) - M(K£) - M(tt 6 ) distribu- 
tion results, see Figure 2. The momentum of the 
D can only be determined up to a two-fold am- 
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Figure 1. Right-sign (upper) and wrong-sign 
(lower) mixing signals for Kir (left) and Ktttttt 
(right) events 



biguity, based on balancing the the momentum 
of the D meson decay products about its line-of- 
flight, as determined from the vertexing informa- 
tion. The shape of the background for the ws 
signal fits is determined from combining Z?'s and 
7rt, 's from different events as in the hadronic case. 
A MLF to the Q and decay time distributions is 
performed. The results for r m i X are summarized 
in Table 2. 
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Figure 2. Right sign and wrong sign semileptonic 
decays used in the mixing analysis. The back- 
ground and fit projections are superimposed. 
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Table 1 

Results of the MLF to hadronic mixing data described by Eq. 1 

Fit Type Parameter E791 Result 90%CL Other 



Most General, 

No CP Assumptions 

CP allowed only in 
Interference Term 



(D°) 

1 mix 



(0.70t°,;| ± 0.18)% 
(0.18i° ;fi ± 0.17)% 

(0.391°;^ ± 0.16)% 



< 1.45% 

< 0.74% 

< 0.85% 



No CP Violation 
No Interference 

No Mixing 



r Dcs {Ktttttt) 



(0.21™ ± 0.02)% 



(0.68™ ± 0.07)% 
(0.25+° f 4 ± 0.03)% 



< 0.33% 



< 0.37% 
E691@ 

(0.77 ±0.35)% 
CLEOil 



Table 2 

Results of the MLF to semileptonic 


mixing data described by Eq.l 






Fit Type 


Parameter 


E791 Result 


90%CL 


Other 


Most General, 
Average 


r m ix (Kev) 
r mix (K^v) 
r mix (Klv) 


(0.16™ ±0.18)% 
(0.06™ ±0.18)% 
(0.11™ ±0.18)% 


< 0.50% 





3. CP Violation 

CP violating effects are also predicted to be 
small in the standard model In order for CP 
violation to occur there must exist two transition 
amplitudes to a final state / which interfere with 
nonzero relative phase. The situation is reached 
in D° decays through mixing (indirect CP viola- 
tion, AC = 2), when interference of CKM cou- 
plings in the relevant amplitudes (\t) of the box 
diagrams occurs, ^(D° — > /) ^ ^>(D° D° — > 
/). This CP violating asymmetry is suppressed 
by an already low mixing rate, and is not expected 
to be seen, O(10 -10 ). Direct CP violating ef- 
fects will manifest themselves in decay rate asym- 
metries of both neutral and charged D mesons, 
A^i=r(D— > /)— r(S— »f) . ... . 

r(D^f)+r(D^f) — ■ particle and antiparti- 

cle asymmetry may be produced by final state 
interactions and penguin terms in Cabibbo sup- 
pressed modes. These CP violating rate asym- 
metries in singly Cabibbo suppressed (SCS) D° 



and D + decays may be as high as a few times 
10 -3 0). Current experiments have not tested 
Acp beyond the « 10 _1 range. 

3.1. Singly Cabibbo Suppressed Searches 

E791 has searched for CP violating effects in 
the SCS decay channels D° -> K+K-,ir+ir- de- 
cays, and D + — > K + K~n + decays. Previous 
searches in these channels have yielded null re- 
sults ]l0|-jl2|]. We have also searched for decay 
rate asymmetries in D + — ► tt + tt~tt + decays |l3|], 
for the first time. To remove D/D production 
and reconstruction asymmetries, we normalize 
each SCS mode to its CF counterpart (K~n + , 
K~tt + it + ) and reformulate a working definition 
of the CP asymmetry as 

a cp = m^m, (2 ) 

V (D)+r ] (Dy 

where rj(D) = iv^T^yi is the ratio of the 
number of SCS to CF decays. 
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In the decay D + — > K + K~tt + , we have in- 
spected each subresonance 4>tt + , K*K, as well as 
the nonresonant KKir for individual CP violat- 
ing asymmetries. We have investigated D + — > 
7r + 7r _ 7r + decays, inclusively, shown in Figure 
3. In each case the selection criteria for the 
SCS mode is arrived at by optimizing S/y/S + B 
where S is the scaled-to-SCS-level CF decay and 
B is the background for that SCS decay. The 
normalizing CF mode is subject to the same op- 
timizing cuts as its SCS counterpart to minimize 
systematic uncertainties. Backgrounds from CF 
mass reflections and particle misidentification are 
also removed. A simultaneous MLF fit for the 
particle/ antiparticle yields is performed to arrive 
at the preliminary CP asymmetries listed in Ta- 
ble 3. 
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Figure 3. D + — > 7r ± 7r T 7r ± events used in the 
CP asymmetry calculation. The Ktttt reflection 
below 1.83 GeV was excluded from the fit. 



In the two-body D° — ► tt + it~, K + K + decays, 
Figure 4, a similar approach is taken. Here we 
show the joint D° — ► Ktt, KK, and tttt decay 
modes used in the CP asymmetry analysis. We 
use SCS D° decays which are tagged by the 
D*+ -> D°tt+ and then D° -> K+K~, tt+tt- de- 
cays. We normalize each SCS yield to the tagged 
CF counterpart, D — > K~tt + . Again, we re- 
move backgrounds from the CF mass reflections 
and particle misidentification. As a consistency 
check of a null result we also determine Acp for 
the CF mode D° -> K-tt+tt+tt-. A MLF fit is 



performed to determine the particle/antiparticle 
yields. We list preliminary results for these CP 
asymmetry measurements, also in Table 3. 



Signal: 63,043 ± 370 Signal: 6,725 ± 163 Signal: 2,595 ± 122 




GeV/c' 

M(K~7t + ) M(K"K + ) M(JtV) 

Figure 4. D° — > ir + ir~ , K + K~ events used in the 
CP asymmetry calculation 



4. Conclusion 

E791 has made an exhaustive search for D°D 
mixing in Cabibbo favored hadronic and semilep- 
tonic decays. We have also searched for CP vio- 
lating asymmetries in singly Cabibbo suppressed 
modes including D + — > 7T7r7r decays for the first 
time. All measurements of mixing and CP viola- 
tion are consistent with zero. With both hadronic 
and semileptonic mixing studies we have achieved 
sensitivities on the order of 5 x 10~ 3 based on gen- 
eral assumptions, possibly testing standard model 
extensions. We have improved CP asymmetry 
measurements of SCS decays, in some cases to 
the (2-5)% range, but are not yet approaching a 
sensitivity of O(10~ 3 ) where CP violating asym- 
metries are predicted in SCS decays in the stan- 
dard model. 
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Table 3 

Preliminary CP asymmetry limits set by E791 and other experiments for CS D + and D a decays 

Other 



-0.031 ±0.068 [ 11 1 
0.066 ± 0.086 |l| 
-0.012 ±0.013 |fl| 

0.080 ±0.061 ill 



Mode 


A C p 


90%CL Limit (%) 


Ktttt 


- .032 




KKtt 


-0.014 ±0.029 


-6.2 < A CP < +3.4 


<j)TT 


-0.028 ±0.036 


-8.7 < A C p < +3.1 


— *0 

K K 


-0.010 ±0.050 


-9.2 < A C p < +7.2 


TTTTTT 


-0.020 ±0.054 


-8.6 < A C p < +5.2 


KK 


-0.017 ±0.042 


-9.3 < A C p < +6.7 


TTTT 


-0.049 ±0.078 


-17.8 < A C p < +8.0 


Ktttttt 


-0.003 ±0.021 


-3.6 < A C p < +3.1 
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